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Abstract 

The volatility modeling for autoregressive univariate time series is considered. 
A benchmark approach is the stationary ARCH model of Engle (1982). 
Motivated by real data evidence, processes with non constant unconditional 
variance and ARCH effects have been recently introduced. We take into 
account such possible non stationarity and propose simple testing procedures 
for ARCH effects. Adaptive McLeod and Li's portmanteau and ARCH-LM 
tests for checking for second order dynamics are provided. The standard 
versions of these tests, commonly used by practitioners, suppose constant 
unconditional variance. We prove the failure of these standard tests with 
time-varying unconditional variance. The theoretical results are illustrated by 
mean of simulated and real data. 
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1. Introduction 

In the analysis of stationary time series nonlinearities are often taken into account by 
considering models which display conditionally heteroscedastic innovations. Reference 
can be made to the GARCH models introduced by Engle (1982) and BoUerslev (1986) 
or the All-Pass models studied by Andrews, Davis and Breidt (2006). Nevertheless 
using such models induces several important consequences for the time series analysis 
as pointed out in Francq, Roy and Zakoian (2005) or Raissi (2010a) among many 
others. Therefore tests for second order dynamics are needed to determine whether 
the whole dynamics of a stationary time series is captured by modeling the variations 
in the level series, or nonlinear models have to be adjusted to the error process. 

It is well known that the squared residuals of stationary error processes with non- 
linear effects are generally correlated. Two benchmark tests for testing the presence 
of second order dynamics are based on this simple remark: the Lagrange Multiplier 
test for detecting ARCH effects (ARCH-LM) proposed by Engle (1982) and the port- 
manteau test developed by McLeod and Li (1983) to detect correlation in the squared 
residuals. It is important to note that testing for second order dynamics in the error 
process is not equivalent to testing its independence. 

The benchmark ARCH-LM and portmanteau tests suppose the stationarity of the 
error process, an assumption that could be unrealistic in many cases. Numerous 
recent works have emphasized that time series often exhibit time- varying unconditional 
volatility. For instance Warnock and Warnock (2000) noted a reduction in volatility 
for U.S. employment data. Blanchard and Simon (2001) documented a substantial 
decline for U.S. output volatility. Sensier and van Dijk (2004) found that most of 
the 214 U.S. macroeconomic time series they considered have a break in volatil- 
ity. Therefore tools taking into account such situations have been recently proposed. 
Kim and Park (2010) investigated cointegrated systems assuming smooth changes 
for the unconditional variance. The statistical inference of stock returns processes 
with possible time varying unconditional variance has been investigated by Engle and 
Rangel (2008), Mikosch and Starica (2004), Starica and Granger (2005) or Spokoiny 
(2009) among others. In particular Starica (2003) used a deterministic structure 
for the non-constant unconditional variance of stock returns and found that such a 
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specification may be preferred to tlie usual stationary GARCH(1,1) for forecasting 
purposes. Chandler and Polonik (2012) proposed a test for investigating the modes of 
non constant unconditional variances. Francq and Gautier (2004) considered ARMA 
processes allowing for unconditional time- varying variance driven by a Markov chain. 
Berkes, Horvath and Kokoszka (2004) proposed a test for detecting abrupt changes in 
the dynamics of the unconditional variance in a GARCH context. More precisely they 
tested the null hypothesis of standard stationary GARCH model against parameter 
change at a given date under the alternative which entails non constant unconditional 
variance. In the multivariate context Aue, Hermann, Horvath and Reimherr (2009) 
introduced a test procedure for break detection in the covariance structure. 

In the time series literature several contributions considered models with determin- 
istic variance specification for the innovations to take into account the non constant 
unconditional variance. For instance Bai (2000) or Qu and Perron (2007) studied vector 
autoregressive processes with deterministic abrupt variance shifts. Xu and Phillips 
(2008) proposed adaptive estimators for autoregressive parameters of stable univariate 
processes using kernel smoothing of the unconditional variance of the innovations. 
Raissi (2010b) and Patilea and Raissi (2011,2012) extended the work of Xu and Phillips 
and proposed modified tools for the usual specification-estimation-validation modeling 
cycle of multivariate autoregressive stable processes in the non standard framework of 
a nonparametric unconditional variance of the innovations. In these contributions the 
error processes are not allowed to exhibit second order dynamics and in general the 
asymptotic results break down in the presence of such nonlinear effects. Therefore using 
the tools developed assuming a deterministic volatility while second order dynamics 
are also present have no theoretical basis and could be misleading. On the other hand, 
models with stochastic volatility specification have been proposed. Engle and Rangel 
(2008) and Hafner and Linton (2010) among others studied models which display 
both non constant conditional and unconditional variance. Dahlhaus and Subba Rao 
(2006) investigated the properties of time varying ARCH (tvARCH) processes which 
are locally stationary but have a long run time varying unconditional variance change. 

In this paper we propose simple statistical tools allowing to analyze the volatility 
specification of a univariate time-series and decide between the two situations: time- 
varying variance with or without second order (stochastic) dynamics. These tools are 
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also effective for detecting second order dynamics with constant unconditional variance. 
Our approaches are based on the following simple fact: stochastic volatility generally 
displays correlated squared residuals while no such correlations occur with deterministic 
time-varying volatility. Hence, new tests for second order dynamics are proposed as 
extensions of the benchmark Engle's ARCH-LM test and McLeod and Li's portmanteau 
test considered in the stationary case, and implemented in most specialized software. 
More precisely, we extend the ARCH-LM test to the case of possibly non stationary 
but stable autoregressive processes where the constant term in the ARCH structure 
is allowed to depend on time. Moreover, a modified portmanteau test based on the 
squared residuals which take into account non constant volatility is also developed. 
These new tests rely on the nonparametric kernel estimation of the unconditional 
volatility function. We prove that they are asymptotically chi-square distributed 
under the null hypothesis of no second second order dynamics. Our theoretical results 
are derived uniformly in the bandwidth and hence we provide theoretical basis for 
data-driven bandwidths rules. The technical conditions imposed on the unconditional 
volatility are very mild and allow for general volatility patterns such like breaks, trends 
and cycles. It is also shown in this paper that in general the standard McLeod and Li 
test statistic and the ARCH-LM test statistic tend to infinity as fast as the series length 
under the null hypothesis of no second order dynamics, provided that the innovations 
variance depends on time. Therefore the standard tools for testing the presence of 
second order dynamics in the innovation process are very likely to spuriously reject 
the null hypothesis and should be avoided in the non standard, but quite realistic, 
framework considered herein. 

The structure of the paper is as follows. In section [2] the (unconditional) het- 
eroscedastic autoregressive model is outlined. The unconditional variance specification 
of the errors process is discussed. In section |3] we extend the model by allowing for an 
additional ARCH structure. This general model will be the framework for our ARCH- 
LM test, while the model with (unconditional) heteroscedasticity introduced in section 
[2] will represent the null hypothesis. The portmanteau test we propose is introduced 
in the same framework though for this type of test the alternative hypothesis could be 
more general. For a more clear presentation, in section [3] we introduce our tests under 
the simplifying assumption of known volatility structure. These tests with modified 
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statistics that take into account the non constant unconditional volatihty have standard 
asymptotic chi-square distributions. In section 2] the infeasible statistics based on 
known volatihty are approximated using a kernel smoothing estimator of the volatility. 
Using these results, feasible adaptive tests for second order dynamics in the series are 
proposed. In section [5] we formally prove that in general the standard ARCH-LM 
and McLeod and Li tests do not distinguish between unconditional heteroscedasticity 
with no second order dynamics effects and the case where the squared residuals are 
correlated. The finite sample properties of the new tests are investigated by mean of 
Monte Carlo experiments in section [HI Moreover, the unreliability of the classical tests 
is illustrated. Some practical guidelines for a suitable choice of the bandwidth for the 
adaptive tests are given. Monte Carlo and bootstrap procedures improving the size of 
the adaptive tests are proposed. It turns out that the adaptive tests combined with 
the numerical methods for size correction are able to correctly take into account for 
time- varying unconditional variance when the second order dynamics are investigated. 
Moreover, the adaptive tests behave well when the unconditional variance is constant 
and thus the time series is stationary. Applications to several U.S. economic and 
financial real data sets are also presented: the second order dynamics of the innovations 
of the Ml monetary aggregate, the Producer Price Index (PPI) for all commodities 
and the Consumers Price Index (CPI) for all urban consumers for communication are 
studied. The technical proofs are gathered in the Appendix. 

2. A time varying specification of the volatility 

Let the univariate autoregressive process (xt) satisfy 

xt = aoixt-i + \-aopXt-p + ut (2.1) 

ut = htet, 

where aoi G K, 1 < i < p, are such that det(a(z)) ^ for all \z\ < 1, with 
a{z) = 1 — Y^^=i o-oi^^ ■ Note that all the results stated in the paper may be extended 
easily to the unit root case. We suppose that a;_p+i, . . . , xi, . . . , a;„ are observed. We 
also define Ft = cr(es,s < t) as the cr-field generated by {es,s < t}. Consider the 
following conditions on the innovations process {ut) where the rescaling approach of 
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Dahlhaus (1997) is used for specifying the structure of the variance. 

Assumption Al: The /it's are given by ht = g{t/n), where g{-) is a mea- 
surable deterministic and strictly positive function on the interval (0,1], such that 
sup^g(Q \g{r)\ < oo, and g{-) satisfies a piecewise Lipschitz condition on (0, IjQ The 
process (ci) is assumed independent identically distributed (iid) of unit variance and 
such that Edetl") < oo for some s > 8. 

Assumption Al allows for a constant function g(-) which corresponds to the stan- 
dard case of a stationary process (xt). In the sequel we will use e to denote a generic 
random variable distributed as et- Under the Assumption Al we have Cov(m( , Uj_j) = 
for all i 7^ 0, and hence our assumption delineate the framework of the null hypothesis 
of our tests. A wide range of unconditional non constant variance is taken into account 
as for instance abrupt shifts, periodic or monotonic heteroscedasticity. Such framework 
was considered by Xu and Phillips (2008). Note that their assumptions E{et\J-t-i) — 
and i?(e( |J^t_i) = 1 are more general but fairly close to our iid condition. Pesaran and 
Timmerman (2004) considered innovations with abrupt unconditional changes of the 
unconditional variance. Many applied papers assume piecewise constant volatility as 
in Batbekh, Osborn, Sensier and van Dijk (2007). Finally note that the autoregressive 
order p of model (|2.ip is usually unknown. A well specified autoregressive order is 
important for testing for second order dynamics. However, the order p can be identified 
and checked under Al using the tools proposed in Rai'ssi (2010b) and Patilea and Raissi 
(2011) and hence we will assume in the sequel that the lag length is well specified. 

In the stationary case it is well known that considering stochastic volatility for the 
error process entails second order dynamics in general (see e.g. Amendola and Francq 
(2009)). In the framework of non constant unconditional variance we note that the 
stochastic volatility specifications in Engle and Rangel (2008) or Boswijk and Zu (2007) 
entail Cov(mj , u^_^) ^ for some i 0. Hafner and Linton (2010) studied the following 



tThe piecewise Lipschitz condition means: there exists a positive integer p and some mutually 
disjoint intervals Ii, . . . , Ip with /i U ■ ■ • U /p = (0, 1] such that g{r) = JZf— i 9;{'")l{re-rj}' ^ -'^1' 
where gi{-), ■ . ■ ,3p( ) are Lipschitz smooth functions on 7i, . . . ,Ip, respectively. 
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model 

ut = Y.{tlnYl^G\l^tt, (2.2) 

where Yi{t/n) verifies similar conditions to g{t/n) and Gt follow a BEKK model (in- 
troduced by Engle and Kroner (1995)) allowing for second order dependence. 

Autoregressive processes with possibly second order dynamics in the innovations 
could arise in many cases. It is well known that an invertible ARMA process can be 
approximated by an AR model with a large enough lag length. However assuming 
independent innovations for this AR model may appear too strong. Similarly, the 
assumption of independent errors is questionable in the important cases where an AR 
model is adjusted to a temporal aggregated time series. A further example arises when 
the univariate series is a component of a multivariate system with an error vector 
with cross-correlated components. Therefore it may be advisable to test for second 
order dynamics effects for the innovations in such situations. Considering model (j2.1|) 
to study the dynamics of a stable process with stochastic effects in the non constant 
unconditional variance innovations could be unreliable in many cases. Indeed some 
technical arguments used when assumptions like Al are considered are no longer valid 
if Cov(u( , u1_j) ^ 0. In the stationary case it is well known that ignoring the presence 
of nonlinearities in the data can be quite misleading as pointed out by Francq and 
Rai'ssi (2007). It seems reasonable to imagine that a similar claim remains true with a 
time-varying variance. On the other hand considering a stochastic volatility as in (|2.2p 
may lead to unnecessary sophisticated structure and more complicated procedures, 
when second order dynamics are actually not present in the data. Finally, let us point 
out that in terms of level prediction model (|2.ip imply that the best predictor for Xn+i 
is linear, while it is well known that this is not always the case when nonlinearities 
are present in the data. In addition following Starica (2003) one can propose forecasts 
of the variance using the specification given by Al which can be different by nature 
from the ones induced by some model allowing for stochastic effects for the variance 
as in Hafner and Linton (2010) section 7.1. The predictions delivered by modeling the 
variance structure have important applications in finance, as for instance for portfolio 
allocation or Value-at-Risk evaluation. As a consequence these different forecasting 
interpretations or methodologies could have implications for these tasks. 
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In view of all the arguments enumerated above, we aim to provide simple tools 
which can help the practitioner to choose between a model specification only based on 
Assumption Al and a specification which allow for second order dynamics together 
with unconditional heteroscedasticity. 

3. Tests with the prior knowledge of the volatility structure 

To better explain the differences with the stationary framework, in this section we 
suppose that the true unconditional variance specified as in Assumption Al is 
given. In the following section we show how could be estimated from data without 
changing the asymptotic behavior of the test statistics. 

Consider the modej^l 

xt ^ aoixt^i -\ \-aopXt-p + Ut (3.1) 

Uf = htet, (3.2) 
/ij = /ij + aoiUt_i H haomwLmi (3-3) 

where the aoi's are assumed nonnegative and ht is defined as in Assumption Al. 
Based on specification p.3p stochastic effects in the volatility of the errors are tested 
by considering the following pair of hypotheses 

Ho : aoi = 0, VI < i < m vs. Hi : 31 < i < m such that aoi > 0, (3.4) 

for a given to > fixed by the practitioner. Under the null hypothesis we have ht = ht, 
that is the non constant innovations variance with no second order dynamics described 
in the previous section. 

3.1. LM-type test 

First we consider the extension of the Lagrange Multiplier (LM) test proposed 
by Engle (1982) for detecting ARCH effects in stationary processes. In the classical 
ARCH-LM test the hts are assumed constant under the conditional homoscedasticity 

■l-Like in the stationary case, see section 8 of Engle (1982), the model l|3.1|l could be specified in 
a slightly more general way: hf = h'^ + ?){cioi"t_i + ■ ■ ■ + <^0mu1_^) where v is some given positive 
differentiable function. For simplicity, we consider that v{-) is the identity function. 
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hypothesis. On the other hand if we suppose that there exists I < i < m such that 
aoi > and g{-) continuous in Al, the process (ut) generated by equations p.2p 
and p.3p is a particular case of the ARCH processes with time varying coefficients 
(tvARCH) studied by Dahlhaus and Subba Rao (2006). If we assume that the /it's 
have an abrupt change, we obtain a process which is closely related to the ARCH(oo) 
structure with a change-point for the constant introduced in Kokoszka and Leipus 
(2000). If aoi > for some i E {l,...,m}, the process (u^) is serially correlated. 
However it is important to recall that with the LM approach one does not estimate 
the full model with stochastic volatility given by (|3.ip - (|3.3p . 

Let ^0 a-nd t?o denote the true unknown values of the parameters 

6 = (ai, . . . , Op)' e KP and ?9 = (ai, . . . , a„0' G R"\ 

Let the gaussian quasi log-likelihood function (up to a constant) of the model p.ll) - (|3.3p 

with ?t = ||f4+ log fe(^)), (3.5) 

for any ip = (6' ^d')' and 

ut{9) = xt - aixt-i ttpXt-p, h^{(p) = + aiu^_^{0) -\ h amul_^{9), 

provided C{(f) exists. By definition, ut{9) = when t < {). The (normalized) score 
vector for any constrained ip'^ = (0', 0)' is given by 

I dc{v) _ I ^\ ui{e)dhl{^) ^ 1 dhl{^)\ 



where t/t-i(0) = {uf_i{9)/h'^, . . . ,u^_^{6)/hfy . Let us introduce the generalized least- 
squares (GLS hereafter) estimator 

where x^ = (xt, . . . ,xt-p+i). Xu and Phillips (2008) showed that under Assumption 
Al, and if Hq is true, the GLS estimator is consistent and asymptotically normal with 
rate y/n. In the sequel convergence in law is denoted by =>. The proof of the following 
proposition is given in the Appendix. 
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Proposition 3.1. Under Assumption Al and if the hypothesis Hq holds true, S{9) 
Af{0, S), where the asymptotic m x m covariance matrix is given by 



Var{e^ 



I E{e^) 1 ••• 1 \ 

1 E{t^) ••• 1 



V 1 1 ... E{e^) ) 

It is easy to see from (|7.ip that Var(ej ) and E{ef) can be consistently estimated by 

Var = - V - 1, or alternatively Var = - V - - 

t=i * t=i * \ t=i * / 

and 

t=i * 

under the null hypothesis. Let S denote a consistent estimator of E. Since -E(e^) > 
E'^{e^) = 1, S is non singular at least asymptotically. 

Now we have all the elements required to introduce the LM test for second order 
dynamics in the innovations process with known variance structure. Consider the 
(infeasible) test statistic 

QGLs = s{o)'t-^s{e). 

Proposition 3.2. Under the conditions of Proposition \3.1\ Qgls asymptotically 
distributed as a Xm random variable. 

The GLS LM test we propose consists to reject the null hypothesis of no second 
order dynamics for the innovations at the asymptotic level v if 

-P(Xm > Qgls I x^p+i,--- ,x„) < v. 

Now let us consider the alternative hypothesis of second order dynamics for the 
process (wt). For ease of exposition we suppose that ut is observed and we consider 
the case m = 1 with agi > 0. Noting that 



we have 
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n ^ I ft" 

We can also write 



- = ^LH- +-L M • (3.6) 



\ ft? J h? n ^ \ ht J n ^ hf 



H — 

i=0 



taking ft/ constant for I < and provided that this sum exists. Let us introduce 
~ sup( ftj and ~ inft ftj . which are such that 0<T<r<ooby Al. We have 



t=i t=i \ / — t=i 



t=i t=i \ / — 

Define = J^Zo "oie?-,: • ■ • e? and Ut = "EZo "oieL^ so that 

;^2:^*-i<— Ei^i^j <;^2:-*-i- (3-8) 

t=i t=i \ / — t=i 

Note that the processes (ut) and (u^) corresponds to stationary ARCH(l) processes 
with autoregressive parameter aoi. Therefore by the ergodic theorem the upper and 
the lower bounds in p.8p converge to some strictly positive constants, provided that 
-^(1 IJit 1^'^) < ^(1 1'''^) < 0° fo'" some r > iP. In particular it follows that 
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n ^—^ \ ht 



> C + Op(l), 



for some c > 0. In the same way it can be shown that the weight matrix E, defined 
using Var(e^) and E{e^), is bounded in probability. It is also clear that the second term 
on the right-hand side of p.6p is Op(l) since (e^ — 1) is independent of Klu'^_^. Indeed 
we have = + J2Hi ^^oi^t-i^t-i ■ ■ ■ ^t-i- Hence we have Qgls > Cn + Op{n) for 
some constant C > and this ensures the consistency of the GLS LM test. 

3.2. McLeod and Li type test 

In this part we extend the test of McLeod and Li (1983) to detect the possible 
presence of second order dynamics in the series. Define 

" ^tT^ / 3 {r)dr + Op{l) 

) Jo 



^This induces restrictions on the parameter aoi. For instance we must have aoi < 0.57 if the 
process (et) is standard Gaussian. If such restriction hold it is clear that the sum in 1 13.71 1 is well 
defined. However note that we do not require that g(.) is continuous under the alternative. 
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and 

= = + Ml) 

-B(e8) Jo 

with E{e^) ~ '127=1 ''^ti^)^-t^ ■ The two Op(l) rates above could be obtained under 
Al, and assuming that Hq is true, using similar arguments to that in Lemma 1 and 2 
of Phihips and Xu (2006). 

Consider the following infeasible Ljung-Box type portmanteau statistic 

Qgls = + 2) Er'W/(n-z)|^, 

where r{i) ~ 7(^/7(0) and 

71 

7(j) = n-' (^) - E{u^t)}{uU{e) - E{ut^)}, 0<j< m, 

for a given m > fixed by the practitioner. Let us recall that E{u^) ~ hi under the 
null hypothesis. The following proposition gives the asymptotic critical values of the 
Q*GLS statistic. 

Proposition 3.3. Under Assumption Al and if Hq holds true, Q*Q]^g Xm- 

The asymptotic behavior of the Q*Qi^g can be obtained straightforwardly considering 
a decomposition as in equation (|7.ip in the Appendix and the following results which 
can be established using arguments like in Lemma 1 and 2 of Phillips and Xu (2006). 

Lemma 3.1. Under Assumption Al and if Hq holds true, 

7„(0) := j^iul ~ E{ul)f = {E{e^) 1} /' g\r)dr + o,(l), 

n 

„^„(j) := Y,{n1 " E{ul)}{uU " E{uU)} => ^ (O, 
t=i 

where 

a'^ ^ {E{e') ^ ir f 9\r)dr. 

Jo 

In addition 

lim Cov{ni^riii),n^ln{j)) = 0, i^j. 
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Using Proposition 1231 one can propose a portmanteau test for second order dynam- 
ics based on the prior knowledge of ht: reject the null hypothesis of no second order 
dynamics for the innovations at the asymptotic level v if 

P{xli > Qgls I a;-p+i, - ■■ ,xi,--- ,xn) < v- 

Under the alternative of second order dynamics for (ut) we also have Q^j^g = C'n + 
Op{n) for some C > so that the GLS LB test is consistent. This can be seen by 
considering similar arguments to that used for the Qgls statistic. 



4. Adaptive tests for second order dynamics for time series with non 

constant variance 

In this section we propose feasible tests based on approximations of the Qgls and 
Qgls statistics. We first provide an estimator of the unknown under Hq. Let us 
define the usual Ordinary Least Squares (OLS) estimator 

and let Ut{0) be the OLS residuals. Following Xu and Phillips (2008) we define an 
adaptive estimator of the variance structure using the OLS residuals 

n 

1=1 

with wu = ^tj) Ku and 



K{{t-i)/nb) if t^i 
if t^i, 



where K{-) is a kernel function on the real line and b is the bandwidth. Let us consider 
the adaptive estimator 
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Assumption Al': Suppose that Assumption Al liolds true and 



inf n(r) > c > 

re(0,ll ~ 



for some constant c. 



Assumption A2: (i) The kernel /v (•) is a bounded density function defined on 
the real line such that K(-) is nondecreasing on (—00, 0] and decreasing on [0, 00) and 
J^v'^K{v)dv < 00. The function K{-) is differentiable except a finite number of points 
and the derivative K'{-) satisfies \xK' {x)\dx < 00. Moreover, the Fourier Transform 
J^[K]{-) of K{-) satisfies |sf | J'[X](s)| ds < 00 for some t > 0. 

(ii) The bandwidth b, I < k < I < d, are taken in the range *B„ = [cminbn , Cmaxbn] 
with < Cmin < Cmax < oo and nbj^^'' + 1/nbf-^^'' — > as ?7 — > 00, for some small 7 > 0. 

Under the Assumptions Al' and A2, Patilea and Raissi (2011) showed that 

V^{e - 0) = opil), 

uniformly with respect to b <E *B„Q Most of the common kernels used in practice 
satisfy the technical conditions imposed in Assumption A2-(i). The uniformity with 
respect to the bandwidth provides a theoretical basis for data-driven bandwidth rules, 
for instance for bandwidth obtained cross-validation as proposed in section IH] below. 

We are now able to introduce the adaptive tests for second order dynamics. Define 
the following adaptive ARCH-LM statistic which approximate the infeasible GLS 
ARCH-LM statistic 

QALs = s{9y^-^s{e), 

where 

with Ut-i{9) = {Uf_i{9)/hf, . . . ,uf_„^{9)/hf y for any 9 e W is the approximated 
score vector. The weight matrix is given by 



^For proving that 8 — 9 is negligible the condition nfe* ''^ — ^ could be replaced by 6,1 — > while K' 
integrable may replace the condition \xK' {x)\dx < 00. The more restrictive conditions we impose 
here on the bandwidth and the kernel will serve in the proof of Proposition 14.11 for rendering the bias 
induced by the nonparametric smoothing negligible. 



Testing for dependence in stable innovations processes 



15 



Var{e^) 



E{e') 1 



1 \ 

1 



1 Eie^) ... 
V 1 1 ... Eie^) J 



where 



Var(e^) =n-^y^ ^ 

t=l "t 



t=l 



and E{e^) = n'^ ^ 



can be taken. Define 



and 



with E{e^ 



UJ4 



E{e^) 



g\r)dr + 0^(1) 



.g«(r)dr + Op(l) 



(4.2) 



^ '^{^)^t We also consider the adaptive portmanteau test 



statistic which approximate the infeasible portmanteau statistic 



where as above f(i) = 7(i)/7(0) and 

1 " 



(4.3) 



where E{u^) = can be taken. In the following proposition we state the asymptotic 
equivalence between the adaptive test statistics and the infeasible test statistics based 
on the knowledge of the variance structure. This equivalence is obtained uniformly 
with respect to 6 e *8„. 

Proposition 4.1. Under Assumptions Al ' and A2 and if Hq holds true, for any fixed 
m > 1, Qals ~ Qgls + Op(l) and Q\]^g = Q*gls uniformly with respect to 

b e 58„. Consequently, QalSi Qals ^ Xm foi~ my data-driven sequence of bandwidths 
in Q5„. 
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Proposition 14.11 provides feasible versions of the ARCH-LM and portmanteau tests 
introduced in section [3] for testing for second order dependence in the presence of time- 
varying variance. The proof given in the Appendix remains valid in the standard case 
of a constant unconditional variance. 

5. Inadequacy of the standard tests 

The benchmark Engle's ARCH-LM test and McLeod and Li's portmanteau test are 
implemented in most specialized software and the standard statistics are compared 
with x^~type critical values. In this section we show that when ht is not constant 
(for instance ht is piecewise constant with a single change-point), these two standard 
statistics grow to infinity as fast as n. This means that in the presence of non 
constant time- varying volatility the standard versions of ARCH-LM and McLeod and 
Li tests spuriously reject the null hypothesis of non second order dynamics effects 
with probability tending to 1. It is well-known that the standard ARCH-LM statistic 
is equivalent to a standard portmanteau statistic, see for instance section 5.4.2 of 
Francq and Zakoi'an (2010). Hence it will suffice to investigate the failure of the 
classical McLeod and Li portmanteau statistic in the presence of time- varying variance, 
the same conclusion will apply to the standard ARCH-LM statistic. The theoretical 
investigation presented in this section will be completed by empirical examples in the 
following section. 

Let W2 = n^^ X!r=i (^) ~ lo + Op(l). Consider the standard portmanteau 

test 

m 

Q^ = n(n + 2)^4(j)/(n-*), 

1=1 

where rs{i) — 7s(*)/7s(0) and 
1 " 

7s(i) = - V (u?-W2)(u?-i-<^2), i € {0, 1,...,™}. 
n ^ — ' 

t=l+i 
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Let write 

n n 



t=l+i t=l+i 



--: ri„(i) H hr4„(i), say. 



The term r4„(i) could be written 



r4n(i) = - I 9\r)d^ (^/it, - ^ + Op(l) T^nii) + Op{l) 



where r4„(i) is deterministic. By arguments similar to those used for equation ([57 
under Al we have 



1 / .1 ^ 2 



n-5r4„(j)=/ g\r)dr-{ g'{r)dr\ +o(l), (5.1) 







2 



for any \ < i < m. Since /J^ g'^{r)dr — y J^^ g^{r)drj > if /it is not constant, deduce 
that for all 1 < i < TO, r4„(i) = cn^ +Op(n^) with c a strictly positive constant. Using 
the Lindeberg CLT and the Slutsky Lemma, deduce that for any i, ri„(i) to T^n{i) are 
asymptotically normally distributed with zero mean and some complicated asymptotic 
variances. It follows that Q*g = Cn + Op{n) for some strictly positive constant C. 



6. Numerical illustrations 

We conducted extensive empirical experiments using simulated and real data sets 
to study the performances and to illustrate the new test procedures introduced above. 
Two aspects were investigated using simulated samples: data-driven bandwidths choices 
and finite sample corrections of the tests level. The lessons we obtained from the 
simulations were applied to the US economic series studied hereinafter. 

In practice, the adaptive procedures we propose require a bandwidth selection rule. 
There is a huge statistical literature on how to select the bandwidth when using 
kernel smoothing for regression functions. However, there is no reason to expect 
that a bandwidth that is 'optimal' for regression estimation purposes would auto- 
matically yield reasonable level and power in a testing procedure, in particular for 
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the ones we consider herein. That is why we considered two types of data-driven 
bandwidth rules. First we followed the classical cross-validation (CV) approach and 
we searched for the bandwidth minimizing a CV criterion like X]"=i ~ '^t (^)P- 
The approach would produce bandwidths b that decrease as fast as n~^^^, see Hardle, 
Marron (1985). That is why we fixed the set *8„ defined in Assumption A2 to be of 
the form [c„ii„ri,~^/^, Cmaxn^^^^], for some constants Cmim Cmax, and we minimized 
the CV criterion over this range. 

Second we propose a kind of 'rule of thumb' calibrated to provide accurate levels. 
Our rule of thumb searches a bandwidth like b = ^{a'^ /nY^^ where is the empirical 
variance of u1, t = The constant 7 belongs to some finite grid of positive 

numbers and is calibrated by simulation in order to obtain accurate levels. Clearly, 
there is no reason to expect that the same constant 7 will be selected for the two types 
of tests that we consider. In subsection 16.21 we explain how to perform this calibration 
with real data. 

Concerning the finite sample corrections of the critical values, two approaches are 
proposed. On one hand, we considered bootstrap counterparts for our adaptive tests. 
More precisely, we follow the simple procedure described in Francq and Zakoi'an (2010, 
p335) in a stationary GARCH context for generating bootstrap data. In short the 
bootstrap statistics are computed according to the following steps: 

1- Compute It — Ut{6)/ht for i = 1, . . . , n. 

2- Generate for t = by drawing randomly with replacement from 
ei, . . . , e„. 

3- Construct the bootstrap residuals uf' = ^l^ht for t = 1, . . . , n and the bootstrap 
series of xt using the autoregressive model. 

4- Build the kernel estimator hf^ 's from the OLS residuals obtained with bootstrap 
series. Next, compute the adaptive estimator 

5- Compute the score vector S'^''^ (resp. the autocorrelations f{i)'^^\ i = 1, • • • ,m) 
as in (resp. as in (gSD) using the ut{9'^''^ys and the /if''s. 

6- Compute the bootstrap version Q^^\^g of the adaptive LM test statistics (resp. 
the bootstrap version Q*j^''i^g of the adaptive portmanteau test statistic) . 
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7- Repeat the steps 2 to 6 i? times for some large B. Use Q\]^s ^-'^'^ Q*als'^ (resp. 
Qals a-iid QaLs'^) compute the bootstrap p- values of the portmanteau (resp. 
LM) test. 

In our simulations we considered B = 499 bootstrap iterations. To avoid estimating 
higher order moments that may introduce some instability in the results, we preferred 
the following versions of the adaptive test statistics 

ni 

QALS=S{9yS{e) and Q^^^ = n(n + 2) ^ f2(z)/(7i - z) (6.1) 

1=1 

and their bootstrap counterparts. Under the assumptions of Proposition 14. II we have 

m 

Qals^^k*C/2 and Q*als ^ ^xl^, 

i=l 

where S ~ Jq g^if)dr/ ^/^ (7'*(r)dr^ , the J/^'s are independent A/'(0, 1) variables and 
the the eigenvalues of the matrix E defined in Proposition 13.11 

On the other hand, we used the following Monte Carlo procedure to replicate the 
asymptotic distribution of the test statistics: 

(a) Draw rjt, t = l,...,n, iid centered random variables of variance 1 and finite 
moment of order 3; the rjts are independent of the observations; to generate these 
variables we used the distribution introduced by Mammen (1993), that is P{rjt — 
-(^/5 - l)/2) = (V5 + 1)/(2V5) and P(?7t = (^5 + l)/2) = (VS - 1)7(2^5). 

(b) Define 

6 = m{ul{e)/hl - l)U:_M and Ctii) = r^t{u1{e) - hl}r^t-^{uU{0) - hU}. 

where U;_M = {iit-i{ul_,{e) - 1) + 1, ...,vt-m{u^-m{d)/h't - 1) + !)• Con- 
sider 

1 " 

5(^~)W = -^^6 and f(z)W = 7(*)(''V7(0)('') 

(c) Compute the statistics Q'^^j^g and Q*^^g like in (|6.ip but with S{0) and f(i) 
replaced by S{6)'^^^ and f{i)^'^\ respectively. 

(d) Repeat steps (a) to (c) R times for some large R. Use Q\i^g and Q^^'^J^'s (resp. 
Qals and Q^^g's) to compute the p-values of the portmanteau (resp. LM) test. 
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In our simulations we considered R — 499 Monte Carlo iterations. The Monte Carlo 
procedure presented above does not require to resample the observations Xt's, so that 
the possible problem of explosive processes with roots within the unit circle is avoided. 
However, the autoregressive order p in (j2.ip should be carefully fitted for the original 
data to avoid spurious rejections. Patilea and Rai'ssi (2011) and Raissi (2010) provide 
suitable tools for testing linear restrictions on the autoregressive coefficients ai, . . . , Op 
and choosing the autoregressive order p in the presence of time- varying variance. 

In the sequel we denote by LMs and LBs the standard ARCH-LM and portmanteau 
tests. Similarly, let LMcls, LAIals, LBgls and LBals be the modified GLS and 
ALS tests we introduced in Sections [3] and 21 The results for the infeasible LMgls 
and LBgls tests represent a benchmark for our adaptive approach. As pointed out 
above the ALS tests are subject to bandwidth choice and finite sample improvements. 
The subscripts "sm" and "la" are used for relatively small or large bandwidth choices 
of the form b = 7((T^/n)^''^. We use the subscript "cw" when the bandwidth is selected 
by cross-validation. The superscripts "b" and "mc" denote the use of the bootstrap 
and Monte Carlo methods described above for the ALS tests. In summary LM^v.als^ 
LM^'^j^j^g and LBcv,alS: -^-^"'als correspond to tests for which the bandwidth is 
selected automatically from the data. Tests like LM^^ als^ -^^'^la als^ ^-'^'^ ^^srn als' 
^^Ya^ALS correspond to tests with bandwidths b ~ ^{cP' jnf-l^ for suitable 7. The 
constant 7 for such bandwidths may be fixed in practice using a preliminary simulation 
experiment as illustrated in the real data analysis belowlj] 

6.1. Simulation experiments 

To assess the finite sample performances of the tests considered in this paper, we 
simulate N = 1000 independent trajectories of lengths n = 100, n = 200 and n = 500 
following the model 



II Tests based on bandwidth selected by cross-validation together with bootstrap critical values 
could be also considered. However, such tests require much more computation time in applications 
and hence will be omitted. 
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where the process (et) is iid standard Gaussian. The simulated data (ut) have non 
constant unconditional variance if the /ij's change over time. Recall that the /it's are 
driven by some deterministic function g{r) with r £ [0,1]. For the homoscedastic 
case we take g{r) = 20, V?' G (0,1]. The time- varying variance specification has 
a sinusoidal form g{r) = 30 — 10sin(1.57rr + 7r/6)(l + r). In view of numerous 
data sets we investigated (most of them not reported here) this variance specification 
produces trajectories that mimic some realistic features. In particular the sinusoidal 
form reproduces the variance clustering sometimes observed in real data. In all the 
experiments we test the null hypothesis of no second order dynamics for the innovations 
process at the (asymptotic) level 5%. With this specification we retained the values 
7 = 0.12 (resp. 7 = 0.2) for determining small (resp. large) bandwidths b. 

6.1.1. The behavior under the null hypothesis 

First, we set ao = and = h^. In such situation there is no second order 
dynamics, that is Cov(ii( , uf_^) ~ for all i Q. The results are provided in Table[T]for 
the heteroscedastic case, and in Table [5] for the homoscedastic case. Table [1] indicates 
that the standard tests tend to reject spuriously the null hypothesis as the sample 
size is increased when the unconditional variance is not constant. This illustrates the 
results of Section [5] where we formally proved the inadequacy of the standard tests in 
our non standard framework. 

Concerning the portmanteau tests, we note that the very simple LBcv,als test with 
automatic bandwidth cross-validation selection deliver quite good results for m = 1. 
In general the LBcv.als and LBgls have similar results in our non standard case. 
In particular for large m, the LBcv.als a-i^d LBgls tests become oversized. This size 
distortion can be corrected using the Monte Carlo approach for the adaptive tests. 
When a rule of thumb is used for the bandwidth selection we found that small 7 is 
preferable to obtain relative rejection frequencies close to the 5% for large m. Let 
us point out that the bandwidths corresponding to small 7 are generally close to the 
bandwidths selected by cross-validation. 

On the other hand for the LAL tests, we remark that the tests with automatic 
bandwidth choice by cross-validation do not give satisfactory results. It is found that 
the Monte Carlo corrections are disappointing in all the cases. On the other hand if 
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the bandwidth b — ^{cP' jn)^!^ is selected using some appropriate rule of thumb, it 
appears that the bootstrap corrections improve the results. More precisely it turns out 
that the 7 have to be taken large to obtain relative rejections frequencies which are 
in general close to the 5% level when the unconditional variance is time-varying. It is 
interesting to note that in such a case large 7 give bandwidths which are somewhat 
far from the bandwidths selected by cross-validation. In conclusion for the LM tests 
it emerges that only bootstrap correction can provide adaptive tests sharing the nice 
properties of the LMqls test. 

Finally if the unconditional variance is in fact constant it turns out from Table 
[5] that the adaptive LM tests with bootstrap correction have generally satisfactory 
results when compared to the valid standard ARCH-LM test. We also remark that 
the adaptive and standard portmanteau tests have in general comparable results in 
the homoscedastic case. Therefore the size accuracy of the tests providing a good 
control of the error of first kind in the non standard case is not deteriorated when the 
unconditional variance is constant. 

6.1.2. The behavior under the alternative hypothesis 

Now we turn to experiments with second order dynamics for the process (ut) and 
we take ao = 0.2, 0.4, 0.6, with again to = 1, 3, 5. The variance is set time-varying and 
constant as above. We focus on the power properties of the LM^^ als^ -^^cv^als 
LB^J^ ALS tests that showed a good control of the type I errors in almost all the studied 
situations. The outputs for the simple LBcv,als test for to = 1 are also displayed. 
The results for the infeasible GLS tests are given when the variance is not constant, 
while the standard tests are considered for the homoscedastic case. We only report the 
case with sample size n = 200, the results for n = 100 and n = 500 are similar. The 
results are presented in Figure [Ql for the heteroscedastic case, and in Figure \8l2\ and 
for the homoscedastic case. 

From Figure 18.11 it appears that the GLS tests are more powerful than the ALS 
tests. Nevertheless recall that the GLS tests are built on the unrealistic assumption of 
known ht which make them infeasible in applications. Now considering the outputs for 
the homoscedastic case in Figure |8^ it turns out that the standard tests have some 
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power advantage on most of the adaptive portmanteau tests. However, we noted that 
the LM^^ ^j^g has similar properties to the standard tests, which may be explained 
by the fact that larger bandwidths allows for more accurate estimates of a constant 
variance function. Finally it seems that all the tests are subject to a loss of power as 
m is increased. 

In the light of our simulation experiments we could draw some conclusions and 
provide some guidelines for the real data applications. The standard ARCH-LM and 
McLeod and Li's tests are not able to distinguish between deterministic non constant 
variance and the case where there exists additional second order dynamics in the series. 
Therefore, if there is some clear statistical evidence or an underlying information on the 
data showing that the unconditional variance is not constant, the alternative adaptive 
tests developed in this paper should replace the standard procedures. Clearly, if the 
unconditional variance is constant the simple standard tests are preferable. However, 
we did not found a major loss of performance for some of our more sophisticated tests 
in the standard case. Therefore, in the case of a doubt on the constancy of the variance, 
again the adaptive tests should be preferred. 

The adaptive tests we propose depend on a bandwidth and their performances are 
clearly influenced by the bandwidth choice. Our simulations show that the adaptive 
portmanteau tests behave well in general when the bandwidth is automatically selected 
by cross-validation (m = 1). When m is taken large Monte Carlo corrections for the LB 
tests provide quite good results. These tests have the advantage that the bandwidth 
is selected automatically from the data. Portmanteau tests with bandwidth chosen 
by fixing some appropriate multiplicative constant can be used as well. However, we 
noted that in general the appropriate constant leads to a bandwidth close to the one 
obtained by cross-validation. Hence we recommend the simple bandwidth selection by 
cross-validation for the LB approach. For the LM tests the cross-validation bandwidth 
selection yields poor results. For the LM approach the bandwidth has to be fixed using 
some numerical method to guarantee a good control of type I errors. 
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6.2. Real data applications 

Several applications of the tools developed in this paper to real data are presented 
below. The presence of second order dynamics for series which obviously exhibit non 
constant unconditional variance is tested. We discarded the adaptive tests which have 
disappointing results in the light of our simulation experiments. More precisely the 
results of the LB^'^^^j^g will be used for the tests with automatic bandwidth selection. 
The LMj'^ j^j^g or LB^ are considered when the bandwidths are obtained by fixing 
the multiplicative constant 7. The standard tests are reported for comparison. The 
constant 7 is fixed following the data-driven procedure: 

1) Estimate the unconditional time- varying variance by minimizing the CV crite- 
rion. 

2) Approximate the deterministic variance function g^{-) defined in Al using for 
instance the Lagrange interpolation of some points of the estimated variance. 
Let us denote by f)^ the approximate variance. 

3) Compute it = ut{9)/t)t for t = 1, . . . , n and use these values to generate processes 
iij^'' with non constant variance many times following the steps (2) and (3) in the 
bootstrap procedure described above. 

4) For each process generated in the previous step estimate the variance with several 
bandwidths corresponding to several values of 7 and consequently implement the 
LB or LM tests using the Monte-Carlo or bootstrap procedures. 

5) Compute the rejection frequencies for each 7. Select the value 7 for which the 
rejection frequency is close to the desired nominal level. 

For simplicity, in this data-driven procedure for calibrating a suitable value of 7 
we focus on the (ut) process and we do not generate artificial samples of (xt) and 
re-estimate the parameter 9. The uncertainty due to is expected to be negligible in 
our context. Moreover, in order to avoid the computation burden, when calibrating 
the value of 7 one could use a subseries provided that it contains sufficient information 
allowing to approximate reasonably well the unconditional variance. It is interesting 
to note that the 7 values selected through this procedure are generally different for the 
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orders m = 1, 3, 5 in the test statistics. This is not surprising in view of the outputs of 
our simulation experiments. For all the tests we fixed a nominal level of 5%. For the 
bootstrap and Monte-Carlo tests we take B = 499. The p-values are displayed in bold 
type when they are lower than 5%. 

We investigated U.S. economic data: the first differences of the monthly Ml mone- 
tary aggregate and of the monthly Producer Price Index (the PPI for all commodities) 
from February 1, 1959 to September 1. 2012. The length of these series is n = 644. 
The monthly Consumer Price Index (CPI) for all urban consumers for communication 
from February 1998 to September 2012 is also investigated. The length of the series is 
n = 176 for the CPI data. Since the original CPI series has a random walk behavior, 
we considered the series of the first differences for our analysis. The three series 
investigated are plotted in Figure Such series are often studied in the literature: 
see Liitkepohl, Terasvirta and Wolters (1999) and references therein for the Ml data; 
see Grier and Perry (2000) among others for the PPI series; the consumer price indexes 
are included in many applied works. 

In view of Figiu-e l5T51 it appears that the unconditional variance of the Ml, PPI and 
and CPI is globally increasing. From 1973 for the PPI and from 1979 for the Ml, we 
also observe clusters of large values which may indicate the presence of second order 
dynamics. It also emerges that the CPI data display a declining variance. In order to 
study the variance structure of the innovations, we adjusted AR models to the PPI and 
Ml series. Meanwhile, it was found that the CPI series is uncorrelated. To check the 
AR models adequacy we used the portmanteau tests developed in Patilea and Raissi 
(2011) which are valid under Al (the outputs are not displayed here). 

Once the linear dynamics of the series are well captured, we can turn to the analysis 
of the second order dynamics in the uncorrelated processes. For the variance specifica- 
tion of the series a practitioner would likely use a model which takes into account for 
possible non constant unconditional variance but excludes second order dynamics as in 



**The data are available in the website of the research division of the federal reserve bank of 
Saint Louis: www.research.stlouisfed.org, series ID: MISL for the Ml and PPIACO for the PPI, and 
CUSR0000SAE2 for the CPI. 
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Al. Nevertheless in view of the observed variance clustering for the PPI and Ml series, 
more elaborated model specifications allowing for both conditional and unconditional 
non constant variance could be used, as in Engle and Rangel (2008) or Hafner and 
Linton (2010). We aim to provide arguments for fitting an adequate model for the 
variance by testing if second order dynamics are present in the innovations or not. 

We applied the LB^'^j^^g, LMi^ and LB™^ tests to the CPI series. We also 
applied the LB^^Ifj^j^g test to the residuals of the PPI and Ml series. The outputs of 
the adaptive tests are compared with those of the standard test: the results are given 
in Table [3] for the PPI and Ml and in Table H for the CPI. We first remark that the 
p- values of the standard tests are very close to zero so that the null hypothesis of no 
second order dynamics is clearly rejected for the three data series. On the other hand, 
for the PPI and Ml data, for any of the values of m we considered, the p-values of 
the adaptive tests are far above 0.05, so that the null hypothesis of no second order 
dynamics is not rejected. For the CPI data, all but one p-values of the adaptive tests 
are above 0.05, some of them far above 0.05, the exception being the case m = 1. 

In view of Figure 18.31 which clearly reveals a non stationary in variance behavior of 
the three series we investigated, it is likely that the standard tests spuriously reject 
the null hypothesis. Meanwhile, our adaptive tests provide very different conclusions 
which could lead one to confidently reconsider the possibility of using an elaborated 
specification which allow for second order dynamics for the Ml and PPI series. We 
obtain the same conclusion for the CPI series, again on the contrary to the standard 
tests. 
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7. Appendix 

7.1. Proof of Proposition [371] 

The proof being quite straightforward, we only outline the arguments. By the Mean 
Value Theorem 

u^{§) = ^ 2utx!t-i0 - Oo) - 2(r - eoYxt^.JLt-iiO - do) (7.1) 

where 6* is between 6*0 and 9. Recall that ut = ut(^o) and Ut{0) corresponds to the GLS 
residuals. By the Taylor expansion of S{9), since the tii's are independent, y/n{9 — 9o) = 
Op(l), and using similar arguments to those in Lemma 1 and 2 of Phillips and Xu 
(2006), it can be shown that S{9) = S{9o) + Op(l). Since {{u^{9o)/h'^ - l) [/t_i(6'o)} 
is a martingale difference sequence, it follows from the Lindeberg CLT that 5(6*0) is 
asymptotically normally distributed. Noting that the process (e^ — 1) is independent 
with mean zero and finite variance we readily obtain the form of the asymptotic 
covariance matrix 

YaTas{S{9o)) = C^t-i(^o)(7t-i(0o)'| 

limivfi./^-^- 



Considering again arguments like in the proof of Lemmas 1 and 2 in Phillips and Xu 
(2006) deduce that the limit exists and is equal to the positive definite matrix S. 



7.2. Proof of Proposition |47T] 

The proofs of the asymptotic equivalences Qals = Qgls + Op(l) E^nd Q\i^g 
Q*GLS + '^pi'^) ai'^ direct consequences of the following uniform rates 



sup 



1 " 

-Y,{ul[9^)h-^~ulh-^} 



n 
t=i 



Op(l), 5 = 2,4,8, (7.2) 



sup sup 

l<j<m be58„ 



^ {{u\(9^)~h\){u\M. 



-hl){ul_^ 



hU)} 



= Op(l), 

(7.3) 
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sup sup 

l<j<m bG!B„ 



n 

Jn ^-^ 



(7.4) 

where 6'„ — = We will focus on equations ()7.3p and (|7.4p . the arguments 

for proving (|7.2p being similar and much shorter. For deriving these rates we will use 
the following lemma. Below [a] denotes the integer part of the real number a (that is. 
the largest integer smaller than a). 

Lemma 7.1. Suppose that the assumptions of Proposition IJJ] hold true. Let 

/O noo 
K{z)dz + g^{r+) K{z)dz, re[0,l], 
oo Jo 

with g[r~) = lim-|r g{f) and g{r+) = \im.rir g{f) for r e (0, 1), g(O-) = 5(1+) = 0. 
(a) Let k ~ or k = I and 



Snit/n; b) 



s(r, b) 



1 " 

rh ^ 



nb 



i=l 
r/b 



t~i 



nb 



K{{t-i)/nb), 1 < t < n, 



\z\''K{z)dz, re (0,1]. 



I{r-l)/b 

There exists a constant C > independent of n and bn such that 

(J 

sup sup \sn{t/n;b) — s{t/n,b)\ < ——. 
fceB„ i<t<n nbn 



(7.5) 



(b) 



sup sup 

6eB„ re(0,l] 



{hinr] - hfnr]] " D{r) - A„(r) - r„(r) = Op(l/V^), 
where D{r) = G'(r) — 

n n 

^■n{r) =Ywinr]i{ef ~ and r„(r) = ^ u;[„r]i/ij - G(r). 

i=l i=l 

Moreover, D[r) = for all hut a finite number of values r € (0, 1], 



sup sup |A„(r)| = Op 

fceSri 1-6(0,1] 



Vln(l/6„) 
Vnbn 



and sup sup |r„(r)| < C6n, 

be<S„ rG(0,l] 



for some constant C > independent of n and 6„. In particular 



sup sup 

beSn j-e(o,i] 



hfnr]-G{r) =Op(l). 
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Now, let us justify (|7.3p . Let At be a short notation for — and fix 1 < j < 
Using the decomposition (|7.f p and the moment conditions on the process (ct), Vi 



+ AtAt^, + {ul - hl)At-j + - hl_j)At 
+ 2{(u? - + {u'i_j - h't_^)utx:t-iWn - do) 

+ \\e„~9ofRt 

with supj \Rt\ = Op{l). By simple calculations of the mean and the variance, we deduce 
t 

Next, as a direct consequence of Lemma [7.11 and the conditions on &„, 

Iy-a A ^ An(l/6„) , Vbn ln(l/6„)\ , „,,2. ,^ , 

- A,A,_, = j^— ^ + ^= j + 0(6J = o,(l/V^), 

uniformly for b G Sn. Finally, let us decompose 

i - /^?){^„((^ - j)/") + Diit j)/n)} 

def 



n ^ — ' n 

t t,i 



n 
t 



Cln + C2 

with r„(-) and D{-) defined in Lemma [7.f I Take absolute values, use the uniform 
bound for r„(-), the classical Law of large Numbers and the fact that D{r) = except 
a finite set of values r G (0, 1]. Deduce that supf,grg„ \C2n \ = Op{b^) ~ Op{l/^/n). Next, 
decompose 

+ [nbj s{t/n;b)s^{t/n;b) ^^'^ 

def 



Cun + Ci2n- 

Take absolute values and expectation and use the bound (|7.5p three times to deduce 

sup sup \Ci2„\ < — = Op{l/y/n). 
beaSn l<t<n non 
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Finally, note that bCun is a degenerate [/—process of order 2 indexed by a VC family 
of functions. Again, for justifying the VC see the proof of Proposition 4.1 in Patilea 
and Rai'ssi (2012a). Use the uniform rate of such a process, see for instance Sherman 
(1994), and deduce that 

sup sup \Ci2n\ = Op{l/nb) = Op{l/y/n). 

b£<B„ l<t<n 



Gathering facts deduce the equivalence (|7.3|) . 

Now, let us justify (|7.4p . Use the decomposition (|7.ip . some long but elementary 
algebra and arguments that have been already used several times above to write 

- ') ^ - (i - If = ^ - ^ 

with 

(/i?-/.?)(6?-l)«L, 



Rit.j - 



and sup^g23„ supi<t<„ |i?2t,j| = Op(l). By Lemma O sup^g^,^ supi<t<„ |i?it,j | 
Op{l/^/n). Deduce that 



= 5,(0o) + op(l), 
from which the equivalence (|7.4p follows. □ 



Proof of Lemma 17. II 

(a) Let K{x) = \x\''K{x) with k = or k ~ I. Then, for any 1 <t < n 



\snit/n;b)~ s{t/n;b)\ < 



K ( '—^ \-K{z) 



< 



< 



nbn 

C2 



nb 



K' (z) 



dz 



dz 



Til 



bn ' 



(7.6) 



for some constants Ci, C2 > independent of i, n and br, 
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(b) By the decomposition (|7.ip . for any 1 < t < n 



hj-h^t~ An{t/n) - Tnit/n) - D{t/n) 



2 ^ WtiUjS (6'„ - ^o) 



def 



1=1 



2S[,{9^eo) + \\en-eo\\^Op{i)S: 



2t, 



where the Op(l) term is independent of n and b. Next, note that Sit is a sum of 
centered zero-covariance random vectors. For a given sequence of bandwidths b the 
variance of du tends to zero, uniformly with respect to t. To derive the uniform rate for 
6i[nr] one could first replace (l/nb) K{{[nr] — i)/nb) in the denominator of W[nr]i by 
JI^J^^^^^K{z)dz. Let (5i[„r] be the quantity obtained after this change of denominators. 
Proceeding like in equation (j7.7p below, it is easy to see that (5i[„r] — <5i[rir] = Op(l) 
uniformly with respect to to 1 < r < 1 and b G *B„. To get the uniform rate of S^nr] 
one can use the uniform Law of Large Numbers for Vapnik-Chervonenkis (VC) classes 
of functions (see for instance van der Vaart and Wellner, 1996). The VC property could 
be established following the lines of the proof of Proposition 4.1 in Patilea and Raissi 
(2012a). Finally, by the definition of the weights wu and the moment conditions on 
the et's, we have d2t < max^ ||a;j_]^|p = Op{y/n), uniformly with respect to b. Since g{-) 
is continuous except a finite set of points in (0, 1], deduce D{r) = for all but a finite 
number of values r G (0, 1]. 

To derive the uniform bound for r„(-) let us write for r G [0, 1], 



r„(r) = 



i< [nr] 



i> [7vr] 



where ck = J-oo K{z)dz and by definition X]i<o ' ' ' = X]i>i • • • = 0. Next, if r > we 
write 



■i< [nr] 



K [nr] 



i< [nr] 



CK 



On the other hand, by the arguments used for equation (j7.6p . the last absolute value is 
of uniform order 1/nbn. Using the piecewise Lipschitz property and again inequalities 
like in equation (|7.6p , there exists < vi < r and some constants Ci , C2 , C3 > such 
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that 



2<[nr] [nri] <?< [nr] 



\[nr]/n)~g^{r-)\Y W[„r]i+2 sup .g^(r) ^ 



i< [7vr] 

i — \nr] 



[nri]<i<[nr] 



nb 



0<r<l 

nbn 



i< [nri ] 



bn / \z\K{z)dz + l/nbn 



Similarly, if r < 1 there exists r < r2 < 1 and some constant C4 such that 



^ W[„r]ih^ - (1 - CK)g'^{r+) 
z>[nr] 



< Ca 



\z\K{z)dz + 1/nbr, 



Deduce the uniform rate for r„(-). 

Next, for a given sequence of bandwidths and a fixed r, up to the logarithm factor, 
the rate of A„(r) is a standard asymptotic result in nonparametric regression. To derive 
the uniform rate for A„(-), consider s„(r; b) defined with fc = and the corresponding 
s(r; b) that is constant equal to 1 for r £ (0, 1), s(0+; b) = ck and s(l— ; b) = 1 — ck- 
Use the simple identity = j/^^ + x^^{y — x)y^^ , x,y 0, and write 



An{t/n) 



s{t/n; b) nb 



nb 



(7.7) 



+ 



n 



t - i 



def 



f{t/n;b)sn{t/n;b) nb \ nb 

Anit/n) + Rn{t/n). 



{s{t/n;b)-s„{t/n;b)}ie^-l)hf 



Take absolute values and expectation and use the bound (I7.5P three times and deduce 



sup sup \Rnit/n)\ = Op{l/nbn) = Op{l/y/n). 
6es„ i<t<Ti 

The uniform rate of A„(-) could be obtained from Theorem 2.14.16 of van der Vaart 
and Wellner (1996). □ 
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8. Appendix B: Tables and Figures 

Table 1: Empirical size (in %) of the tests for second order dynamics. The innovations 
heteroscedastic. 
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Table 2: Empirical size (in %) of the tests for second order dynamics. The innovations are 
homoscedastic. 
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Table 3: The p-values (in %) of the tests for testing the presence of second order dynamics 
in the residuals of the Ml and PPI data. 
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Table 4: The p-values (in %) of the tests for testing the presence of second order dynamics 
in the residuals of the FDI and CPI data. 
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Figure 8.3: The first differences of the studied data: The monthly PPI index on the top left panel 
and the monthly Ml on the top right panel from 2/1/1959 to 9/1/2012 (n = 644). The monthly CPI 
from 2/1/1998 to 9/1/2012 is displayed on the bottom panel (n = 176). Data source: The research 
division of the federal reserve bank of Saint Louis, www.research.stlouis.org. 



